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This study reports the development and validation process for an instrument to 
measure university students’ anxiety in physics courses. The development of the Physics 
Anxiety Rating Scale (PARS) included the following steps: Generation of scale items, 
content validation, construct validation, and reliability calculation. The results of 
construct validity analysis with 495 university education students showed that the scale 
consisted of four components: Physics course/test anxiety, anxiety about lack of physics 
knowledge, mathematics anxiety, and physics laboratory anxiety. The Cronbach’s alpha 
reliability coefficient was found as .95 for the whole scale and for the components it 
ranged from .83 to .92. Confirmatory factor analysis, using another sample of 864 
university education students with similar characteristics as the previous sample 
suggested that the four factor model for the PARS is valid. Hence, each component 
displayed satisfactory internal consistency reliability. According to findings, the PARS 
may be a useful tool in identifying the anxiety of undergraduate students taking physics 
courses. It can be used to determine students' physics anxiety in a particular course for 
instructional purposes or it can be used as a pre-and post-test to determine the change 
in students’ physics anxiety. 

Keywords : factor analysis; physics anxiety; scale development and validation; science 
anxiety 

INTRODUCTION 

Research about effective teaching and learning of science has focused on two 
dimensions. The first is the investigation of cognitive processes, and the second is 
the study of the affective factors. It is pointed out that instructional strategies that 
regard only cognitive variables may ignore the consideration of individual's affective 
characteristics such as intentions, goals, experiences, and emotions (Pintrich, Marx, 
& Boyle, 1993; Randier et al., 2011). For instance, earlier research criticized physics 
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teaching for not taking into account students' such affective characteristics 
(Schwedes, 1973], To help students improve their scientific thinking and abilities, 
instructors need to take into account both affective and cognitive factors of learning 
(Laukenmann et al., 2003; Mallow & Greenburg, 1983], 

In studies dealing with the psychology of learning, one can identify various 
theoretical approaches pertaining to the role of emotions in learning. One aspect 
that is emphasized is the strong relationship between emotion and motivation. 
Another emotional dimension of the affective factors that has received increasing 
attention in recent decades is anxiety. Among negative emotions, anxiety has 
considerable significance in learning and achievement situations. 

Anxiety is defined as an unpleasant emotional state of uncertainty, fear, worry, 
discomfort, loss of control, and expectation that something bad will happen (Sapir & 
Aronson, 1990; Scovel, 1991], Anxiety is an important variable that can influence the 
learning process (Chapin, 1989; Phillips, 1984], Anxiety-creating situations may 
sometimes enhance an individual's performance. Alpert and Haber (I960] identified 
negative and positive dimensions of anxiety which were named as debilitating 
achievement anxiety and facilitating achievement anxiety. Although a low level of 
anxiety may have a positive effect on achievement, high anxiety may severely 
impede it. 

Science Anxiety 

The term anxiety has been around for more than a century. However, the concept 
of "science anxiety" was coined by Mallow in 1977 at Loyola University Chicago. The 
first Science Anxiety Clinic was founded at Loyola University Chicago (Mallow, 
1978], Researchers developed techniques in the clinic to reduce science anxiety by 
blending three separate approaches: (1] science skills learning, (2] changing of 
students' negative self-thoughts, and (3] desensitization, through muscle relaxation, 
to science anxiety-producing scenarios (Mallow, 1981], Several studies were carried 
out to assess the effectiveness of the clinic (Alvaro, 1978; Hermes, 1985], Alvaro and 
Hermes showed that clinic group students' anxiety was reduced significantly 
compared to students in control groups. The Science Anxiety Questionnaire (SAQ] 
was developed by Alvaro (1978] and used in numerous subsequent studies 
(Brownlow et al., 2000; Bryant et al., 2013; Mallow 1994, 1998; Kastrup & Mallow, 
2007; Udo et al. 2001, 2004] The SAQ is a 44-item questionnaire that asks students 
to imagine themselves in certain situations and to rate their level of anxiety on a 5- 
point Likert scale: "not at all," "a little," "a fair amount," "much," or "very much." 
Items of the SAQ are evenly divided between science and nonscience content, with 
emphasis on analogues situations, such as studying for a science exam versus 
studying for a history exam. 

Science anxiety was defined as a diffuse or vague fear which arises in science 
learning situations (Mallow, 1978], It is suggested that like other negative feelings, 
anxiety results from intervening self-messages rather than from the science learning 
itself. Such messages as "I can never solve these problems, I just don't have a mind of 
a scientist" or "If I can't pass this physics course, I'll never graduate from school" 
produce anxiety and reduce performance in the physics course (Mallow & 
Greenburg, 1983], 

Science anxiety can also be related to family, school, or environment. Among the 
factors causing science anxiety, as well as negative thoughts, unwanted negative 
memories of the past and worrying plans towards the future can be mentioned. For 
instance, sarcastic and insulting behavior of a science teacher in the past, an 
unsuccessful science experiment, or parents' discouraging comments towards 
science learning can cause anxiety towards science (Mallow & Greenburg, 1983], 
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The psychological studies illustrate the significance of emotions in both learning 
and performance situations (e.g., Moller, 1996], Jerusalem and Pekrun (1999] 
reported that positive emotions were frequently related to learning and 
performance situations. Czerniak and Chiarelott (1984) indicted science anxiety as a 
factor influencing science achievement in primary school students and suggested 
that high science anxiety may cause low science achievement. There is a general 
agreement in the empirical literature that test anxiety is associated with lower 
academic performance (Zeidner, 1998). A meta-analysis of 562 studies from 
elementary school through college indicated that test anxiety reduced academic 
performance at every educational level (Hembree, 1988). Research showed that test 
anxiety is associated with lower student grade point average (GPA), but there are 
few large scale studies investigating the relationship between test anxiety and GPA 
in undergraduate students (Chapell et al., 2005). One such study reported a 
significant but small inverse relationship between test anxiety and GPA in both 
undergraduate and graduate students (Chapell et ah, 2005). 

Studies also showed differences between male and female students' science 
anxiety levels (Bryant et ah, 2013; El-Anzi, 2005; Mallow, 1994, 1995; Mallow, 2006; 
Mallow et ah, 2010; Udo, Ramsey, & Mallow, 2004; Udo, Ramsey, Reynolds-Alpert, & 
Mallow, 2001). Females were usually found to be more anxious than males. 
However, several studies reported females and males to have similar science anxiety 
levels in a sample of American university students (Brownlow, Jacobi, & Rogers, 

2000) and Turkish pre-service elementary teachers (Bursal, 2008). 

The problem of students' lack of confidence and gender differences in physics 
classes has long been recognized (Fuller et ah, 1985). Underrepresentation of 
women in the so called 'hard' sciences, especially in physics-related careers 
continues to be the focus of many research studies (Reid & Skryabina, 2003). Girls' 
interest has been shown to be higher toward sciences than males in the lower 
grades (Labudde, Herzog, Neuenschwander, Violi, & Gerber, 2000). However, in later 
schooling and at the time of career decisions, women tend to avoid science-related 
careers. Research suggests several explanations for career choices of women 
(Murphy & Whitelegg, 2006). Among them are the negative attitudes (Sharma, 
Stewart, Wilson, & Gokalp, 2013) and anxiety they develop during school years. 
Science anxiety has been regarded and reported as a factor creating special 
obstacles for female students in both humanities and the science field (Beyer, 1991). 
Udo, Ramsey, Reynolds-Alpert and Mallow (2001) suggest that different pedagogies 
and gender role models may correlate with anxiety reduction. Astleitner (2000) 
describes instructional strategies that can be used to decrease negative feelings 
(fear, envy, and anger) and to increase positive feelings (sympathy and pleasure). It 
is important that instructional strategies should be put into action to reduce gender 
bifurcation in science anxiety. 

Rationale for the Study 

In the literature, there are numerous scales and questionnaires developed to 
screen different anxiety states. Some of these are, Science Anxiety Questionnaire 
(Alvaro, 1978; Mallow, 1994), Science Anxiety Scale for Primary Students (Giizeller 
& Dogru, 2012), Science Anxiety Survey (Bursal, 2008), Chemistry Laboratory 
Anxiety Instrument (Bowen, 1999), Westside Test Anxiety Scale (Driscoll, 2007), 
The Mathematics Anxiety Rating Scale (Richardson & Suinn, 1972), Test Anxiety 
Inventory (Spielberger, 1980), Cognitive Test Anxiety Scale (Cassady & Johnson, 

2001) , State-Trait Anxiety Inventory (Spielberger, Gorsuch, Lushene, Vagg, & Jacobs, 
1983), Physical Activity and Sport Anxiety Scale (Norton, Hope, & Weeks, 2004). 
These and the others that were not mentioned here have been used and well 
documented in the literature. Although physics anxiety was dealt with as part of 
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affective variables (e.g., Gungor, Eryilmaz, & Fakioglu, 2007], usually it was not dealt 
with as a separate concept in the research studies. Therefore, to the knowledge of 
the authors of the present study, there is no instrument to measure specifically 
physics anxiety of university students in physics classes. Since physics requires 
higher-order cognitive skills, some students may come to physics classes with their 
prejudiced perception of physics as very hard to cope with. Taking this possibility 
into account, the necessity for teachers to seek ways to minimize such perceptions 
and promote positive attitudes is apparent. To work for remedies of physics anxiety 
in our physics classes, firstly students' anxiety should be measured and determined. 
To do this, we need valid and reliable measuring instruments as in all other 
educational research areas. Therefore, the purpose of this study was to develop a 
valid and reliable instrument to measure "physics anxiety" of undergraduate 
students. As previous research (Udo et al., 2001] and the current study revealed, 
education students (pre-service teachers] present significantly higher levels of 
science anxiety. Designing research based instructional strategies according to the 
results of physics anxiety rating scale might prove useful in education of teachers, at 
least for physics components of their science courses, and in education of students 
in other science fields. In this article, the development process of the PARS is 
described in detail (Dilek, §ahin, Giiler, & Eslek, 2013; §ahin, 2014; §ahin, £ah§kan, & 
Dilek, 2012], The PARS can be utilized to measure anxiety levels of students at any 
desired point during a course as well as before and after an intervention study as a 
pre- and posttest to determine possible shifts in anxiety levels. 

METHODOLOGY 

Participants 

The scale was applied to a total of 495 university students enrolled in an 
undergraduate level introductory physics course at a public university in Turkey. 
There were 228 males and 267 females. Great majority of the students were from 
education faculty. They were pre-service teachers of physics, chemistry, biology, 
mathematics, elementary, elementary science, and computer education. Only 
approximately 8% of the participants were freshman engineering students. Due to 
varying department programs, some students took one general physics course 
during their pre-service education (e.g., elementary pre-service teachers]. Some 
students took a general physics course in their first year, others in their second year 
of study (i.e., elementary mathematics and elementary pre-service teachers]. The 
PARS was administered to students during the course time. A second set of data was 
collected from a similar sample of 864 pre-service teachers from the same faculty 
and departments during a two-semester period for further validity analyses of the 
PARS. 

Development Process of the Physics Anxiety Rating Scale (PARS) 

In the development process of the PARS, a procedure consisting of seven steps, 
namely, review of relevant literature, generation of scale items, establishment of 
face validity, construction of the draft scale, pilot testing, administration of the scale, 
and validity and reliability analyses were followed. Details regarding these steps are 
explained below. 

Review of Relevant Literature 

At first, an extensive literature review on studies concerning anxiety in the 
process of education and instruction within the fields of mathematics, chemistry and 
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especially of science/physics was conducted. At the beginning, results of the studies 
concerned with the place of anxiety in education and instruction, the causes and 
results of its effects on an individual's physical and psychological state and on 
learning were revealed. Scales developed for assessing anxiety related to chemistry 
education (Bowen, 1999], math (Alexander & Martray, 1989; Binta$, 2008; Fennema 
& Sherman, 1976; Hopko, Mahadevan, Bare, & Hunt, 2003; Richardson & Suinn, 
1972; Wigfield & Meece, 1988], science education (Chiarelott & Czerniak, 1985; 
Mallow, 1994], and to computer and internet (Ogunkola, 2008; Wang, 2007] were 
examined carefully. The creation of the PARS thus heavily depends on the works of 
others mentioned here and in the rationale section of the paper. 

Item Generation 

After the literature review, items which were used in relevant studies of anxiety 
and which were eligible for the structure and content of a physics course (e.g., lab, 
exam] were selected; and these items, albeit small in number, were revised by the 
authors with respect to the purpose of the scale and goals of a physics course. In 
addition to this, new items related to anxiety which may arise from previous 
experiences about solving physics problems or conducting physics experiments 
were generated. Ultimately, a pool of 60 items covering all likely components of a 
physics course such as problem solving, explaining a physical phenomenon, taking 
exams, conducting experiments, using mathematical knowledge and asking 
questions, was generated. 

Establishment of Face Validity 

The 60 items generated were presented to a panel composed of one science 
education and two physics education experts. The panel was asked to examine the 
clarity of the items, similarity of them with each other and whether the content was 
sufficient to determine the anxiety levels of undergraduate students regarding 
physics courses and, to comment on the consistency of the items. In line with the 
experts' suggestions, 10 items were excluded and 2 items were revised to clarify 
their meaning. 

Construction of the Draft Scale 

The remaining 50 items were used to construct a 5-point Likert-type scale 
ranging from 1 (strongly disagree] to 5 (strongly agree]. 

Pilot Testing 

In order to determine the time required for administration of the scale and to 
pilot test it, using a convenient sample, the scale was applied to a group consisting of 
14 freshman pre-service teachers from the physics education program and 12 
freshman students from the science education program. The students were asked to 
mark the words which they did not know the meaning of and write down their 
suggestions or views about the items, if any existed. Upon completion of the scale, 
short conversations were carried out with each student and, it was concluded that 
the students could understand all of the items clearly and that the required 
administration time was 15 minutes. 


© 2015 iSER, InternationalJ. Sci. Env. Ed., 10(2], 183-200 


187 




M. Sahin, S. Caliskan & U. Dilek 


Administration of the Scale 

In order to assess reliability and validity, the final form of the scale composed of 
50 items was administered to a total of 495 undergraduate students enrolled in a 
physics course. The scale was administered in the classrooms during the first 15 
minutes of each class session under the supervision of the authors. The participants 
were asked to carefully read each item at an average speed and circle the response 
that best described their degree of agreement. 

Validity and Reliability Analyses 


To test the validity and reliability of the scale, IBM SPSS 21 and IBM AMOS 
21statistics software packages were used. For reliability analysis, item-total 
correlations for each item were taken into account; for construct validity, 
exploratory factor analysis was carried out and Cronbach's Alpha reliability 
coefficients of the scale and subscales were calculated. Then, a 4-factor model 
suggested by the exploratory factor analysis was tested with a confirmatory factor 
analysis model using another set of data. The four components were names as, 
physics course/test anxiety, anxiety about lack of physics knowledge, mathematics 
anxiety, and physics laboratory anxiety. 


Table 1. Descriptive statistics and item-total correlations for the factor analysis 



Mean 

SD 

Item-Total 

N 

AnxOl 

3.26 

1.171 

.558 

495 

Anx02 

3.03 

1.110 

.569 

495 

Anx03 

2.29 

1.127 

.531 

495 

Anx04 

2.44 

1.006 

.324 

495 

Anx05 

2.31 

1.081 

.595 

495 

Anx06 

3.28 

1.263 

.614 

495 

Anx07 

2.33 

1.075 

.452 

495 

Anx08 

2.73 

1.100 

.518 

495 

Anx09 

2.74 

1.133 

.622 

495 

AnxlO 

2.97 

1.096 

.590 

495 

Anxll 

2.40 

1.132 

.609 

495 

Anxl2 

3.07 

1.218 

.681 

495 

Anxl3 

2.40 

1.228 

.404 

495 

Anxl4 

2.29 

.974 

.616 

495 

Anxl5 

3.02 

1.290 

.758 

495 

Anxl6 

2.82 

1.366 

.728 

495 

Anxl7 

3.12 

1.209 

.524 

495 

Anxl8 

2.38 

1.086 

.550 

495 

Anxl9 

2.07 

1.029 

.486 

495 

Anx20 

3.01 

1.138 

.708 

495 

Anx21 

2.29 

1.083 

.636 

495 

Anx22 

2.11 

.973 

.618 

495 

Anx23 

3.09 

1.257 

.629 

495 

Anx24 

2.86 

1.206 

.672 

495 

Anx25 

2.07 

1.049 

.506 

495 

Anx26 

2.97 

1.280 

.552 

495 

Anx27 

3.03 

1.210 

.749 

495 

Anx28 

2.49 

1.100 

.644 

495 

Anx29 

2.37 

1.083 

.600 

495 

Anx30 

2.97 

1.181 

.570 

495 

Anx31 

2.75 

1.217 

.585 

495 

Anx32 

2.65 

1.117 

.459 

495 
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RESULTS 

The data were analyzed using IBM SPSS 21 and IBM AMOS 21 and the scale was 
validated via exploratory and confirmatory factor analyses. All statistical analyses 
were set with an alpha level of 0.05. 

Exploratory Factor Analysis (EFA) 

To investigate the factor structure of the PARS, an exploratory factor analysis 
with varimax rotation was carried out. The Bartlett's test of sphericity produced a 
significant result (p< 0.001] indicating the suitability of the factor model for the 
data. The Kaiser-Meyer-Olkin (KMO] Sampling Adequacy coefficient which displays 
the convenience of performing factor analysis for the scale (KMO>0.70] (Dalgety, 
Coll, & Jones, 2003] was calculated as 0.954, which can be regarded as good. All of 
the inter item-total correlations were found to be higher than 0.30. The data were 
then subjected to principle component analysis with varimax rotation. Eliminating 
factor cross loadings and factors whose loadings were less than 0.40 led to the 
exclusion of 18 items from the analyses. Using the factors whose eigenvalues were 
greater than land the scree plot test, four factors were formed including 32 items. 
Factor identification included several analyses steps such as observing Cronbach's 
Alpha values of each factor with and without including troubling items, examining 
scree plot in each case and rereading items for avoiding any misinterpretation while 
including an item into a specific factor. A 4-factor model was decided on as the best 
factor structure for the PARS. The final form of the scale has a maximum point of 
160, and minimum point of 32. High point represents a high level of anxiety. 
Descriptive statistics and item-total correlations for the factor analysis are provided 
in Table 1. 

The distribution of items in each factor and factor loadings at the end of the 
factor analysis are given in Table 2. As seen from Table 2, the factor loadings of the 
items constituting the PARS range between. 455 and .773. 

The eigenvalues, percents of variance, and total percents of variance related to 
the four factors has been given in Table 3. The four factors accounted for 54.96 % of 
the total variance. In the four-factor solution, there were four items (13, 18, 20, 29], 
which loaded into two factors. When the meanings of these items were investigated, 
taking into account their factor loadings in the particular factors, they were included 
in one of the factors only. Some of these items were slightly revised to have the 
adequate meaning in the factor they belong. Actually, these items were correctly 
loaded into corresponding factors with a higher factor loading than the other factor. 
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Table 2. Factor structure and loadings of the 32 items in the PARS 


Item No 

AnxOl 

Anxl5 

Anx27 

Anx02 

Anxl6 

AnxlO 

Anx06 

Anxl2 

Anx23 

Anx22 

Anxl9 

Anxl4 

Anx21 

Anxll 

Anx25 

Anx05 

Anx07 

Anx26 

Anx30 

Anx24 

Anx29 

Anx20 

Anxl7 

Anxl3 

Anx09 

Anx32 

Anx31 

Anx04 

Anxl8 

Anx28 

Anx08 


FI 

.773 

.733 

.733 

.716 

.715 

.699 

.692 

.668 

.630 


F2 


F3 


.725 

.622 

.584 

.581 

.580 

.552 

.526 

.468 


.706 

.691 

.657 

.588 

.585 

.486 

.477 

.455 


F4 


.694 

.694 

.655 

.603 

.593 

.548 

.508 


Anx03 


Table 3. Principle components and the corres 
information of the PARS 

ponding eigenvalue and variance 


Factors 


Eigenvalue 

Percent 

Variance 

Total Variance 

Physics course/test anxiety 

Factor 1 (C/TA) 

12.39 

38.72 

38.72 

Anxiety about lack of physics 
knowledge 

Factor 2 (LPKA) 

2.39 

7.47 

46.18 

Mathematics anxiety 

Factor 3 (MA) 

1.53 

4.79 

50.97 

Physics laboratory anxiety 

Factor 4 (PLA) 

1.28 

3.99 

54.96 


Factor Description 

Items in the first factor are related to being anxious in a physics class or about 
studying for a physics exam. Therefore, this factor was named as physics course/test 
anxiety (C/TA], Items in factor two appear to represent anxiety about not being able 
to explain physics concepts to others or displaying physics content knowledge to 
others. This is perhaps due to a lack of basic understanding of the physics concepts. 
Thus, second factor was named as anxiety about lack of physics knowledge (LPKA). 
Factor three is about being anxious in a physics course due to a lack of mathematical 
knowledge required to succeed in the course, not being able to recall mathematical 


190 


© 2015 iSER, InternationalJ. Sci. Env. Ed., 10(2), 183-200 






Development and validation of the physics anxiety rating scale 


relationships of physical quantities, and studying a physics text full of mathematical 
expressions. Consequently, this factor was named as mathematics anxiety (MA], 
Finally, the fourth factor contains items reflecting anxiety in carrying out a physics 
experiment in a laboratory. In general, items such as being anxious about not being 
able to finish a physics experiment in time, not being able to communicate the 
results of a physics lab, anxiety about working with other students, setting up an 
experiment, and handling lab materials are included in this factor. As a result, it was 
called as physics laboratory anxiety (PLA], 

Reliability of the Emerged Factors 

Internal consistency reliability estimates of the four factors of the PARS were 
determined using Cronbach’s Alpha reliability values for each factor and for the total 
instrument. Table 4 shows the names of the factors, number of items in the factors, 
Cronbach Alpha Reliability Coefficients, and a sample item for each factor. The 
physics course/test anxiety (C/TA] factor contains 9 items and its reliability value is 
0.92. The second factor, anxiety about lack of physics knowledge (LPKA], consists of 
8 items with an alpha value of 0.85. The mathematics anxiety (MA] factor includes 8 
items producing an alpha value of 0.86. The fourth factor, physics laboratory anxiety 
[PLA] contains 7 items and its reliability value is 0.83. The reliability coefficient for 
the whole instrument, using the samples [n=495] in this analysis is 0.95. Table 4 
indicates that reliability values ranged from 0.82 to 0.92 for the four factors of the 
PARS. The reliability of the physics course/test anxiety (C/TA] factor (0.92] is 
considered 'excellent' and reliabilities of 0.83, 0.85, and 0.86 are considered 'good' 
(George and Mallery, 2001; Tabachnick & Fidell, 2007], 

Confirmatory Factor Analysis (CFA) 

A confirmatory factor analysis (CFA] (Brown, 2006; Byrne, 2010] was carried out 
to cross check the results of the exploratory factor analysis, which is a four-factor 
solution for the PARS. Data were collected for a two-semester period from 864 pre¬ 
service teachers from the same faculty and departments as the sample used in EFA. 
Using the new set of data (n=864], the four-factor model for students' anxiety in 
physics courses was tested using AMOS 21 (Arbuckle, 2008], CFA assesses how well 
the proposed model matches the observed data. Several tests exist to determine 
overall model fit. The x 2 statistics is the most common one reported. The result is 
usually reported as the ratio ofy 2 to degrees of freedom (x 2 /df]. However, due to the 
sensitivity of the x 2 statistics to sample size, it becomes difficult to retain the null 
hypothesis as the number of cases increases (Byrne, 2001], Therefore, when the 
sample size is large, the null hypothesis that the model is a good fit to the data can be 
easily rejected. Because of these drawbacks, many alternative fit statistics were 
developed (e.g., Bentler, 1990; Bentler & Bonett, 1980; Hu & Bentler, 1995, 1999; 
Kline, 1998; Ullman, 1996], A common way is to present four or five indices from 
different areas (Arbuckle & Wothke, 1999], The model in this study was evaluated 
using the following goodness-of-fit indices. The x 2 to degrees of freedom (x 2 / df] 
ratio (CMINDF], the goodness of fit index (GFI], the comparative fit index (CFI], the 
Tucker-Lewis index (TLI] and the root mean square error of approximation 
(RMSEA], Traditionally, a non-significant x 2 is a measure of good fit. However, x 2 is 
often significant when the sample size is large and the input variables have a non¬ 
normal distribution (Hu & Bentler, 1999], A CMIN/DF value less than 3 is regarded 
as a good fit. The CFI compares the existing model fit with a null model, which 
specifies no relationship among the observed variables. The GFI is independent of 
sample size. 
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Table 4. Names of the factors, reliabilities, number of items, and sample items for 
the factors in the PARS 


Factors 

# of 

items 

Cronbach J s 

alpha 

Sample Item 

Physics course/test 
anxiety (C/TA) 

9 

0.92 

I am usually yery neryous when I am studying for a 
physics exam. 

Anxiety about lack of 
physics knowledge 
(LPKA), 

8 

0.85 

If my instructor asked me to explain a physical eyent 
from daily life, I would be worried. 

Mathematics anxiety 
(MA) 

8 

0.86 

When I open a physics book, seeing a page full of 
formulas without any explanation scares me. 

Physics laboratory 
anxiety (PLA) 

7 

0.83 

I am very comfortable with using lab materials. 

Whole instrument 

32 

0.95 



The TLI measures the lack of fit of the model to a baseline model, usually the 
independence model, which assumes the observed variables to be uncorrelated. The 
CFI, GFI, and TLI values of 0 indicate no fit, whereas 1 indicates a perfect fit. A 
common criterion for these indices is that values >0.90 indicate a good fit (Bollen & 
Long 1993; Hu & Bentler, 1999], The RMSEA is relatively insensitive to sample size 
and corrects for the number of degrees of freedom (df) in the model. The RMSEA 
values less than 0.08 indicate an acceptable model fit and values less than 0.05 
indicate a good model fit (Bentler & Bonett 1980, Hu & Bentler, 1999], 

A CFA analysis is carried out with a sample of 864 students. The squares 
represent the observed variables and the ellipses show the latent variables [factors]. 
There is also error terms associated with the observed variables indicated with the 
letter e. Maximum likelihood estimation method was employed to test the model. 
The AMOS provided the calculations of modification indices (MI], standardized 
residuals, covariance among error terms, standardized regression weights, and 
squared multiple correlations. Modification indices make suggestions about 
loosening certain model parameters in order to improve the overall model fit. The 
squared multiple correlations provide information on how much variance the 
common factors account for in the observed variables. All standardized regression 
weights were significant (p<0.001] and all critical ratios (C.R.] were larger than two. 
The standardized regression weights can be interpreted as the correlation between 
the observed variable and the corresponding common factor. For this four-factor 
model the regression weights were all significant. Correlations among the four 
factors ranged from 0.65 to 0.82 which indicate good values. The squared multiple 
correlations, R z statistics, ranged from 0.21 to 0.72. The R z values indicate that the 
respective factor explains a respectable portion of the variance (between 21% and 
72%]. 

A close examination of the goodness-of-fit indices, standardized residuals and the 
modification indices indicate the model's misfit and hence suggest that the model 
could be improved. The initial results of the CFA were as follows: The x 2 (df = 458, p 
= 0.000, n = 864] = 1678.73 for the model was statistically significant. CMIN/DF = 
3.665, GFI = 0.887, CFI = 0.907, TLI = 0.899, and RMSEA = 0.056. The corresponding 
goodness-of-fit indices for the initial model and optimal values suggested for these 
indices are reported in Table 5. 
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The Model Fit 


In regard to the MI, the AMOS output revealed several large covariances between 
error terms. Upon examining the modification indices suggested by the AMOS 
output, the standardized residual matrix revealed no significant violations. 
Standardized residuals should be less than 2 in absolute value. As indicated in the 
covariance matrix of the error terms, using covariances between error terms, the x 2 
value could be significantly reduced. For instance, the output revealed large 
covariances between Error 6 and Error 9 (MI = 159.02, EPC = 0.35], The MI also 
suggests adding a covariance between error terms and factors. However, this option 
violates the assumption that the common and the unique factors are uncorrelated. 
Therefore, covariances were added between the error terms only, as suggested by 
the MI. These modifications significantly improved the model. The corresponding 
path diagram for the improved model including significant standardized coefficients 
is presented in Figure 1. Standardized item loadings range from .60 to .87 for the 
C/TA factor, .49 to .69 for the LPKA factor, .44 to .78 for the MA factor, and .48 to .74 
for the PLA factor. The overall model fit appears quite good with CMIN/DF < 3, 
RMSEA < 0.05, and CFI, GFI, and TLI > 0.90. 


Table 5. Model fit statistics of the AMOS CFA solution for the four-factor model of the PARS 


Index Initial Model 


X 2 (df, p) 

CMIN/DF 

CFI 

GFI 

TLI 

RMSEA 


1678.73 (458,0.000)* 

3.665 

0.907 

0.887 

0.899 

0.056 


Improved Model 

1093.397 (445,0.000)* 

2.457 

0.951 

0.926 

0.945 

0.041 


Desired Value 
p > 0.05 
CMIN/DF <3 
CFI > 0.90 
GFI >0.90 
TLI > 0.90 
RMSEA <0.05 


Table 6. Descriptive statistics, internal reliability, and factor intercorrelations for the PARS 


Factor 

M 

SD 

a 

2 

3 

4 

1. Physics course/test anxiety 

28.42 

8.63 

.92 

.72* 

.79* 

.66* 

2. Anxiety about lack of physics 







knowledge 

18.27 

5.69 

.82 

" 

.81* 

.82* 

3. Mathematics anxiety 

22.56 

6.50 

.85 


- 

.73* 

4. Physics laboratory anxiety 

18.84 

5.60 

.83 



- 

Total Scale 

88.08 

22.45 

.95 





The goodness-of-fit indices of the improved model are very close to the optimal 
values reported in the literature. Therefore, this model was deemed a reasonable 
model data fit. Although the x 2 statistics is still significant, the other five indices 
provide evidence of a good fit. The x 2 statistics was reported as problematic since its 
dependence on sample size (Byrne, 2001], The goodness-of-fit indices for the 
improved model along with the optimal values suggested for these indices are 
presented in Table 5. 

In the final AMOS output, the regression weights of all the variables loading into 
their respective factors are between 0.44 and 0.87, with all critical ratios above 2 
(which means that all the regressions are statistically significant at the 95% 
confidence level]. The standardized regression weights (factor loadings] and the 
squared multiple correlations, (R 2 ), were displayed in the path diagram in Figure 1. 
Table 6 presents mean scores, standard deviations, and intercorrelations for each 
factor. Correlations among the four factors are considered moderately high and 
range from .66 (between the C/TA and PLA factor] to .82 (between the LPKA and the 
PLA factor]. 
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Validity 

The results of our analyses lend support to the use of the PARS with university 
students. A multivariate analysis of variance (MANOVA] was conducted to assess the 
effects of gender and cumulative grade point average (gpa] on physics anxiety as 
measured by the four subscales of the PARS. Wilks’ Lambda was selected to evaluate 
overall significance. Results indicated a significant difference for both gender (Wilks' 
Lambda = .859, F(4, 859] = 35.235, p < .001, partial r\ 2 = .141] and grade point 
average (Wilks' Lambda = .920, F(8, 1696] = 8.994, p < .001, partial r\ 2 = .041], A 
follow-up analysis of variance (ANOVA] indicated that females have higher anxiety 
than males on all factors of the PARS. For the variable GPA, AN OVA analysis 
indicated a statistically significant group differences on all four factors of the PARS. 
A post hoc analysis using Bonferroni test indicated that students whose GPAs were 
above 3.00 had higher anxiety scores in C/TA (M = 29.05] and LPKA (M = 18.70] 
factors than students whose GPAs were between 2.00-2.99 (M = 27.13 for C/TA and 
M = 17.40 for LPKA], On MA factor, students whose GPAs were below 2.00 had 
higher anxiety scores (M = 23.96] than students whose GPAs were above 3.00 (M = 
22.52] and between 2.00-2.99 (M = 21.70], who did not differ from each other. It is 
interesting to note that on the LA factor (F4], students whose GPAs were above 3.00 
had higher anxiety scores (M = 20.03] than students whose GPAs were below 2.00 
(M = 17.89] and between 2.00-2.99 (M = 17.88], who did not differ from each other. 

Reliability 

Using the sample of 864 students, Cronbach's alpha reliability analyses were 
conducted to test the internal consistency reliability of the four factors and the 
whole instrument. All of the item total correlations were found to be greater than 
0.3. The alpha values of the four factors were as follows: The physics course/test 
anxiety (C/TA] (a=0.92], the anxiety about lack of physics knowledge (LPKA] 
(a=0.82], the mathematics anxiety (MA] (a=0.85], and the physics laboratory 
anxiety (PLA] (a=0.83]. The alpha value of the whole instrument was 0.95. These 
values, which are considered 'good' and 'excellent', support the reliability of the 
PARS. It can be seen that, the alpha values are very similar to the alpha values of the 
model whose factor structure validity was tested in the EFA. Hence, it can be 
concluded that the PARS is a valid and reliable instrument to measure university 
students' physics anxiety. The PARS can be found in the appendix. 
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Figure 1. The path diagram of overall model fit for the four-factor solution of the 
PARS (where Fl= physics course/test anxiety [C/TA]; F2= anxiety about lack of 
physics knowledge (LPKA]; F3= mathematics anxiety (MA]; and F4= physics 
laboratory anxiety [PLA]]. 


DISCUSSION AND CONCLUSION 


As a result of this study, a valid and reliable evaluation instrument, the physics 
anxiety rating scale (PARS] is developed by the researchers. Exploratory and 
confirmatory factor analyses were performed to examine the construct validity and 
it was concluded that the scale was composed of four subscales accounting for 
54.96% of the total variance. Reliability studies showed that Cronbach’s alpha 
reliability coefficients for the total and subscales were considerably high. 
Intercorrelations among the factors ranged from .66 to .82. To date, the PARS is 
unique in the relevant literature and is thought to bring a new and significant 
perspective to studies concerning physics education. Although there are a few 
science anxiety scales in the literature, none is specific to physics. It can be said that 
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the PARS which has four subscales is practical and appropriate for evaluating 
anxiety which may arise from various teaching/learning situations in physics, and 
will contribute to the relevant literature. 

The analyses of the data in this study revealed that there is a gender difference in 
anxiety and that females are more anxious than males. This finding agrees with the 
result of some previous research (El-Anzi, 2005; Mallow, 1994; Udo et al., 2001], 
The results of this study also suggested a relationship between GPA and physics 
anxiety. Similarly, sesearch indicated a small, significant negative correlation 
between GPA and test anxiety (Chapell et ah, 2005], Test anxiety is one of the four 
factors in the PARS and the results showed that higher test anxiety and higher GPA 
is associated. This seemingly paradoxic pattern is also reported in Chapell et ah 
(2005], Test anxiety is defined as a multidimensional construct consists of many 
complex factors. Therefore, test anxiety should be regarded as one of the many 
variables effecting student grades, and many other factors need to be taken into 
consideration (Zeidner, 1998], 

It is believed that physics anxiety, which appears to be ignored by most of the 
researchers, is one of the significant factors like self-efficacy, attitude and motivation 
which have been studied extensively in the field of physics. The results of this study 
suggest that the PARS will contribute to the understanding of physics anxiety 
phenomenon, provide physics teachers, curriculum developers, and physics 
education researchers with information about "anxiety" which is an important 
affective domain in physics education. 

Since anxiety is a complex construct including many other contributing factors, 
relationships among the factors of physics anxiety and academic achievement need 
to be investigated thoroughly. Further research need to take into consideration that 
although anxiety has an effect on student performance, many other factors should 
also be accounted for, as Zeidner [1998] has indicated: 

Any reasonable model of school achievement needs to consider, along with test 
anxiety, a wide array of cognitive, affective, motivational, somatic, and 
environmental factors (scholastic abilities, study habits, school attitudes, self¬ 
perceptions and self-efficacy, student health, classroom environment, opportunities 
for enrichment, etc.] (Zeidner, 1998, p. 235], 

By considering the possibility that obligatory physics courses offered during the 
first and second years of the programs at the faculties of engineering, science and 
education may arouse different levels of anxiety in different individuals, the value of 
the PARS can be better understood in terms of identifying physics anxiety. In 
addition, for the purposes of examining the effects of particular learning experiences 
on physics anxiety and correlating anxiety with different cognitive, affective or 
psychomotor behaviors, or with different parameters (grade, gender, etc]; the PARS 
can be used as an instrument in physics education. 

IMPLICATIONS 

By using the PARS, undergraduate students' anxiety levels related to physics 
courses can be revealed in detail. For instance, when high levels of anxiety related to 
exams and labs are detected, one can decide to employ a particular instructional 
strategy to overcome the student difficulties in these areas. In this manner, by 
decreasing the anxiety levels of students educators may enhance students' 
understanding and their chance of success in physics can be improved. Finally, 
further research on the validation and refinement of the physics anxiety rating scale 
is needed. Particularly, construct validation may be investigated across different 
populations and settings. In this regard, we hope other researchers use the PARS to 
measure physics anxiety and report their findings about validity and reliability of 
the scale. 
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